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DETAILED ACTION 

Claim Rejections - 35 USC § 112 

1 . The following is a quotation of the second paragraph of 35 U.S. C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

2. Claims 1-37 are rejected under 35 U.S.C. 1 12, second paragraph, as being indefinite for 
failing to particularly point out and distinctly claim the subject matter which applicant regards as 
the invention. 

Claims 1-37 recite "systems" that are improperly defined by process steps rather than 
structural elements. The claims should be rewritten as either "process" (method) claims or 
"system" claims having physical structures for performing the claimed functions. All changes 
must be commensurate with the Specification and must not introduce new matter. 

Claims 14 and 15 recite "mark(s)," which has no antecedent basis in the Specification. It 
appears these are typos and should be changed to "mark" in order to correspond to the 
Specification. 

Claim Rejections - 35 USC §103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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4. Claims 1-11, 14, 15, 17, 20-27, 30, 31, 33, 36, and 37 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over U.S. Patent 6,975,750 by Yan et al. ("Yan") in view of U.S. Patent 
6,879,709 by Tian et al. ("Tian"). 

Regarding claim 1, Yan discloses a face recognition and/or verification system including 
the step of 

registering a persons actual face wherein an image of said actual face is captured and 
synthesized to create a plurality of face prototypes (212, figure 2), 

wherein said face prototypes are stored for later analysis and comparison with a captured 
image to be recognised or verified (214, figure 2). 

Yan teaches that the captured actual images are preferably "frontal" images of a person's 
face (column 1/54-60) but does not appear to disclose that the captured faces are normalized via 
at least one of translational, rotational and scalar transformations, as claimed. 

Tian discloses a face processing system. In particular, Tian teaches that it is conventional 
to "normalize" faces as a preprocessing step in a facial recognition system (column 1/63 — 2/24). 
That is, images of different faces typically exhibit a great deal of variance in position, scale, and 
lighting, and it may be necessary to normalize the faces to compensate for such variations of 
position, pose, scale, and illumination. 

Accordingly, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify Yan by Tian to achieve the claimed invention by normalizing the 
captured facial images, as claimed, since Yan teaches a preference for frontal images, and Tian 
recognizes that in many circumstances it is necessary to normalize inputted facial images in 
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order to transform the faces into a desired position, pose, or scale — i.e., produce a standardized 
frontal view according to Yan's preference. 

Regarding claim 2, Yan discloses said face prototypes represent possible appearances of 
said actual face under various lighting conditions, varying facial expressions, varying facial 
orientations, and/or modeling errors (see e.g., figure 9). 

Regarding claim 3, Yan discloses comparison of said face prototypes and captured image 
uses a face matching algorithm (column 12/12-33). 

Regarding claim 4, Yan discloses comparison of said face prototypes and captured image 
uses face templates or feature vectors (column 12/12-33: feature vectors used as input to neural 
network facial recognizer — see figure 4 of U.S. Pat. 6,944,319, which Yan incorporates by 
reference). 

Regarding claim 5, the combination of Yan and Tian teaches synthesizing of said actual 
face includes normalising said actual face image based on the spatial relationship between at 
least two features of the actual face image (see Tian, column 2/8-24: pose is adjusted based on 
relationship among eyes, nose, and mouth). 

Regarding claim 6, the combination of Yan and Tian teaches normalising includes 
rotating said actual face image to bring eyes of said actual face image to a horizontal plane 
(column 12/12-33: face is rotated to a frontal view, thereby bringing eyes to a horizontal plane). 

Regarding claim 7, the combination of Yan and Tian teaches normalising includes 
scaling said actual face image such that the eyes are a fixed distance apart (column 1/63 — 2/19: 
the segment between the eyes is identified and the face is scaled to a desired scale, thereby 
bringing the face to a standardized frontal view with the eyes a fixed distance apart). 
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Regarding claim 8, the combination of Yan and Tian teaches normalizing the facial 
image to a desired scale but does not expressly disclose that the eyes are fixed at 50 pixels apart. 
However, such a limitation is not considered to patentably distinguish from the combination of 
Yan and Tian since it appears to represent merely an arbitrary facet of the invention. Those 
skilled in the art would have been aware of the relative pros and cons of utilizing any specific 
size of facial images to process and would have taken those factors into consideration as design 
choices dependant upon the particulars of the operating environment. 

Regarding claim 9, Yan discloses the area above the person's eyebrows and below the 
person's mouth is not synthesized (see e.g., figure 6: the area above the eyes (the hair) and the 
area below the mouth (the neck) are not synthesized). 

Regarding claim 10, Yan discloses synthesizing of said actual face includes determining 
alternative positions for each eye so as to compensate for possible errors (see figure 9: 
synthesizing includes determining alternative poses of the face having different eye positions to 
compensate for potential matching errors when recognizing a face captured at an arbitrary pose). 

Regarding claim 11, Yan discloses five alternative positions are determined for each eye 
(see figure 9: more than 5 positions are determined). 

Regarding claim 14, Yan discloses synthesizing of said actual face includes applying at 
least one predefined warping mark to said actual face image (see e.g., figure 6 — textured mesh 
used for warping is applied to the face). 

Regarding claim 15, Yan discloses 25 predefined warping marks are used (see figure 6: 
more than 25 mesh triangles are used). 
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Regarding claim 17, Yan discloses said at least one warping mask includes geometric 
transform (column 9/1-36: the vertices of the mesh triangles are geometrically transformed to 
warp the face). 

Regarding claim 20, Yan discloses a facial prototype synthesis system wherein an image 
of a persons actual face is used for creating a plurality of face prototypes, said face prototypes 
representing possible appearances of said actual face under various lighting conditions, varying 
facial expressions, varying facial orientations, and/or modeling errors, and wherein said face 
prototypes are stored for later use (see e.g., figures 1 and 2). 

Yan teaches that the captured actual images are preferably "frontal" images of a person's 
face (column 1/54-60) but does not appear to disclose that the captured faces are normalized via 
at least one of translational, rotational and scalar transformations, as claimed. 

Tian discloses a face processing system. In particular, Tian teaches that it is conventional 
to "normalize" faces as a preprocessing step in a facial recognition system (column 1/63 — 2/24). 
That is, images of different faces typically exhibit a great deal of variance in position, scale, and 
lighting, and it may be necessary to normalize the faces to compensate for such variations of 
position, pose, scale, and illumination. 

Accordingly, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify Yan by Tian to achieve the claimed invention by normalizing the 
captured facial images, as claimed, since Yan teaches a preference for frontal images, and Tian 
recognizes that in many circumstances it is necessary to normalize inputted facial images in 
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order to transform the faces into a desired position, pose, or scale — i.e., produce a standardized 
frontal view according to Yan's preference. 

Regarding claim 21, the combination of Yan and Tian teaches that said actual face image 
is normalized prior to creating said face prototypes based on the spatial relationship between at 
least two features of the actual face image (see Tian, column 2/8-24: pose is adjusted based on 
relationship among eyes, nose, and mouth). 

Regarding claim 22, Yan discloses normalising includes rotating said actual face image 
to bring eyes of said actual face image to a horizontal plane (column 12/12-33: face is rotated to 
a frontal view, thereby bringing eyes to a horizontal plane). 

Regarding claim 23, Yan discloses normalising includes scaling said actual face image 
such that the eyes are a fixed distance apart (column 1/63 — 2/19: the segment between the eyes 
is identified and the face is scaled to a desired scale, thereby bringing the face to a standardized 
frontal view with the eyes a fixed distance apart). 

Regarding claim 24, the combination of Yan and Tian teaches normalizing the facial 
image to a desired scale but does not expressly disclose that the eyes are fixed at 50 pixels apart. 
However, such a limitation is not considered to patentably distinguish from the combination of 
Yan and Tian since it appears to represent merely an arbitrary facet of the invention. Those 
skilled in the art would have been aware of the relative pros and cons of utilizing any specific 
size of facial images to process and would have taken those factors into consideration as design 
choices dependant upon the particulars of the operating environment. . 
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Regarding claim 25, Yan discloses the area above the persons eyebrows and below the 
persons mouth is not synthesized (see e.g., figure 6: the area above the eyes (the hair) and the 
area below the mouth (the neck) are not synthesized). 

Regarding claim 26, Yan discloses to create said face prototypes said system determines 
alternative positions for each eye so as to compensate for possible errors (see figure 9: 
synthesizing includes determining alternative poses of the face having different eye positions to 
compensate for potential matching errors when recognizing a face captured at an arbitrary pose). 

Regarding claim 27, Yan discloses five alternative positions are determined for each eye 
(see figure 9: more than 5 positions are determined). 

Regarding claim 30, Yan discloses to create said face prototypes said system applies at 
least one predefined warping mask to said actual face image (see e.g., figure 6 — textured mesh 
used for warping is applied to the face). 

Regarding claim 31, Yan discloses 25 predefined warping masks are used (see figure 6: 
more than 25 mesh triangles are used). 

Regarding claim 33, Yan discloses said at least one warping mask includes geometric 
transform (column 9/1-36: the vertices of the mesh triangles are geometrically transformed to 
warp the face). 

Regarding claim 36, Yan discloses said face prototypes are generated by applying 
photometric and/or geometric transforms to said image (column 9/1-36: the vertices of the mesh 
triangles are geometrically transformed to warp the face; column 12/7-1 1 : photometric transform 
is applied). 
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Regarding claim 37, Yan discloses a facial prototype synthesis system wherein an image 
of a persons actual face is synthesized by determining possible alternative eye positions and 
applying at least one mask to said image to create a plurality of face prototypes, and wherein said 
face prototypes represent possible appearances of said actual face under various lighting 
conditions, varying facial expressions, varying facial orientations, and/or modeling errors (see 
e.g., figures 1 and 2). 

Yan teaches that the captured actual images are preferably "frontal" images of a person's 
face (column 1/54-60) but does not appear to disclose that the captured faces are normalized via 
at least one of translational, rotational and scalar transformations, as claimed. 

Tian discloses a face processing system. In particular, Tian teaches that it is conventional 
to "normalize" faces as a preprocessing step in a facial recognition system (column 1/63 — 2/24). 
That is, images of different faces typically exhibit a great deal of variance in position, scale, and 
lighting, and it may be necessary to normalize the faces to compensate for such variations of 
position, pose, scale, and illumination. 

Accordingly, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify Yan by Tian to achieve the claimed invention by normalizing the 
captured facial images, as claimed, since Yan teaches a preference for frontal images, and Tian 
recognizes that in many circumstances it is necessary to normalize inputted facial images in 
order to transform the faces into a desired position, pose, or scale — i.e., produce a standardized 
frontal view according to Yan's preference. 
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5. Claims 12, 13, 19, 28, 29, 32, and 35 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent 6,975,750 by Yan et al. ("Yan") in view of U.S. Patent 6,879,709 
by Tian et al. ("Tian") as applied to claims 1 and 20 above, and further in view of U.S. Patent 
7,221,809 by Geng ("Geng"). 

Regarding claims 12 and 28, Yan teaches that synthesizing of said actual face includes 
adjusting the illumination thereof (column 12/7-1 1). However, Yan does not appear to expressly 
disclose vary the illumination by applying at least one predefined lighting mask to said actual 
face image. 

Geng discloses a facial recognition similar to that of Yan wherein multiple synthesized 
faces are produced from one or two originally captured facial images. In particular, Geng, like 
Yan, teaches that the illumination of the synthesized faces can be varied in order to account for 
potential variations in lighting for recognition purposes. Figure 6 illustrates the concept of 
generating multiple face images under various lighting conditions using predefined lighting 
masks m; (column 6/26-35). 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Yan and Tian by Geng to achieve the claimed invention by applying lighting mask(s) 
to the actual face image as projected onto a 3-D face model since Yan teaches synthetically 
varying the illumination of the face image to generate synthesizes facial images having different 
illuminations, and Geng shows that a conventional way of achieving such a result is via the use 
of lighting masks to vary the pixel colors (column 6/5-35). 
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Regarding claims 13 and 29, Geng does not appear to expressly disclose that three to 16 
predefined lighting masks are used. However, such a limitation is not considered to patentably 
distinguish from the combination of Yan, Tian, and Geng since it appears to represent merely an 
arbitrary facet of the invention. Those skilled in the art would have been aware of the relative 
pros and cons of utilizing any specific number of different lighting masks in order to generate a 
desired number of different faces under differing illuminations and would have taken those 
factors into consideration as design choices dependant upon the particulars of the operating 
environment. 

Regarding claims 16 and 32, Geng discloses said at least one lighting mask includes 
photometric transform (column 6/26-34: the pixel values are changed by mask m;). 

Regarding claims 19 and 35, Geng discloses said photometric transform includes at least 
one of: algorithmic function, exponential stretch, vertical shadow, horizontal shadow and 
differentiating image (column 6/26-34: algorithmic function mi). 

6. Claims 18 and 34 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent 6,975,750 by Yan et al. ("Yan") in view of U.S. Patent 6,879,709 by Tian et al. ("Tian") 
as applied to claims 17 and 33 above, and further in view of "The Integration of Optical Flow 
and deformable Models with Applications to Human Face Shape and Motion Estimation" by 
DeCarlo et al. ("DeCarlo"). 

Regarding claims 18 and 34, Geng does not appear to disclose that said geometric 
transform is estimated using optical flow estimation. However, DeCarlo shows that utilizing 
optical flow estimation to deform a textured face image into various poses and orientations was 
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conventional at the time the invention was made and would have been an obvious expedient to 
those skilled in the art. 

Related Prior Art 

7. Additional prior art document(s) considered by the Examiner but not relied upon are 
listed on the attached "Notice of References Cited." 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Colin M. LaRose whose telephone number is (571) 272-7423. If 
attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Brian 
Werner, can be reached on (571) 272-7401. The fax phone number for the organization where 
this application or proceeding is assigned is (571) 273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. Any inquiry 
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of a general nature or relating to the status of this application or proceeding can also be directed 
to the TC 2600 Customer Service Office whose telephone number is (571) 272-2600. 



/Colin M. LaRose/ 
Colin M. LaRose 
Primary Examiner 
Group Art Unit 2624 
4 August 2008 



